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ABSTRACT 

In this chapter we will derive the equilibrium distribution of states of a model containing four different types of 
service centers and R different classes of customers. From this steady state distribution one can compute the moments of 
the queue sizes for different classes of customers at different service centers, the utilizations of the service centers, the 
“cycle time” or response time for different classes of customers, the “throughput” of different classes of customers, and 
other measures of system performance. 
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INTRODUCTION 



Chandy [4] defines another type of balance equation which he calls the local balance equations. Informally, a 
local balance equation equates the rate of flow into a state by a customer entering a stage of service to the flow out of that 
state due to a customer leaving that stage of service. We associate a customer with a stage of service in the following ways. 
If the customer is in service at a service center, then he is in one of the stages of his service time distribution at that service 
center. If the customer is queued at a service center, then he is in the stage of his service time distribution he will enter 
when next given service. 

To illustrate the concept of local balance we consider the relatively simple network model in Figure 1. 

This is a closed network with two classes of customers (which we refer to as class 1 and class 2). There are Ni 
class 1 customers and N 2 class 2 customers in the networks. All service times are exponentially distributed and 

( i — 1, 2, V — 1, 2) is the mean service time for a class r customer at service center i. 

Mir 




Type 2 

service center 2 



Type 3 

service center 1 



Figure 1: In this Example P x 22 2 = ^2 2-1 2 = ^2 ill ~ 1 > 1 -t 1 + 1 2 l — ^ 
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Let H- be the number of class r customers at service center i. For convenience we write the global and local 
balance equations only for the states in which ft >0, i = 1, 2, T = 1, 2 . 



Global Balance Equation: 
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Equations: 
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Since all the service time distributions in this, example are exponential the current stage of service of a customer 
is uniquely defined by the customer's class and the current service center. Local balance equation (i,r) for 

i = 1, 2, T — 1,2 equates the rate of flow out of state (ft 11? n^ 2 ,fl 2l ,tl 22 ) due to a class r customer leaving service 
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Center i with the rate of flow into state 



(/In, Hp , /7 t | , /7„ ) due to a class r customer entering service center i. 



The value of the local balance concept is that 

• It leads to a simpler and more organized search for solutions for equilibrium state probabilities and 

• It works for a large number of cases (in fact for virtually all of the closed form solutions known for general classes 
of networks of queues— although not many interesting cases have known solutions). 

Before presenting the solution to the class of networks described, we define a set of terms that appear in the 

solution. 

For a customer of class r, let be a solution to the following set of equations. 



Z e ir P i,nj, s +d js= e js ’ 1 
1 <i<N 



The value of d - s is determined by the arrival process of customers of class s to service center j. If there are no 
such arrivals from outside the system, then d , = 0 . If there are such arrivals then d ■ = Cl . . In a closed system there 

J S J S J S 

are no arrivals to any center and all the d j s are zero. In this case 6 [r is the relative frequency of visits to service center i 
by customers of class r. 

Note that a system may be “open” with respect to some classes of customers and “closed” with respect to other 
classes of customers. Our solution applies to this class of system. 

One further definition is required. If at the i th service center the r lh class of customers has a service time 
distribution that is represented as a network of stages then this is represented as illustrated in figure 2. 




The Second Subscript Denotes the Class of Customer And the Third Subscript Denotes the Stage. 

I 

Let 

7=1 

Theorem 1 

Given a network of service stations which is open, closed or mixed in which each service center is of type 1, 2, 3 
or 4. Then the equilibrium state probabilities are given by 
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P(S = x l ,x 2 ,...,x N ) = Cd(s)f l (x l )f 2 (x 2 )...f N (x N ) 

Where C is a normalizing constant chosen to make the equilibrium state probabilities sum to 1, d(S) is a function 
of the total number of customers in system and each /i is a function that depends on the type of service center i. 

If service center i is of type 1 then 




If service center i is of type 2 then 




R u ir 

Tin 



r=l 1 = 1 




If service center i is of type 3 then 





If service center i is of type 4 then 




If the arrivals to the system depend on the total number of customers in the system, M(S), and the arrivals are of 
class r and for center i according to fixed probabilities P ir then 

M(5)-l 

d(S)= II Mi) 

i = 0 

If we have the second type of state dependent arrival process then 
m I 

d(s)=n n v«-> 

7=1 1=0 

If the network is closed then d(S) = 1. 

The theorem is proved by checking that the local balance equations are satisfied. In every case for which these 
results apply the local balance equations reduce to the defining equations for the j 6 n . } . 

SIMPLIFICATION OF RESULTS 

The solution presented for the equilibrium state probabilities deals with system states that are more detailed than 
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is usually required. The more detailed states are necessary to derive the equilibrium state probabilities. Now we define the 
system state as the number of each class of customer in each service center. More formally state S of the system is given by 

(;yp y 2 '>""> y N ) where y<=( f! ( l , tip ) and n ir is the number of customers of class r in service center i. Let «, 

1 

be the total number of customers at service center i and let be the mean service time of a class r customer at service 

Hir 

center i. Then the equilibrium state probabilities are given by 



p {s = (yvy 2 T"’ y N )) = cd (s)g l (y l )g 2 (y 2 )-g N {y N ) 



Where 

If service center i is of type 1 then 



£/U) 





i 

Mi(j) 



if service center i is of type 2 or 4 then 






r= Tn ir \lM ir j 



If service center i is of type 3 then 



ftU)=n J 



r=l Hr 1 



Hr 



Hi, 



In each case the expression for ^ . ( _y . ) j s derived by summing /' ( X- ) over all X i with 

fixed. That this is the correct definition of the g, follows from the product form of the solution given 

The evaluation of the normalizing constant requires summing the given expression for the equilibrium state 
probabilities over all feasible states. In the next section we show a closed form solution for C for an open network in which 

Hi (m) = Hi for all m if service center i is of type one. 



Open Systems 

For open systems it is possible to obtain a closed form solution for the normalization constant when the arrival 
process is of the first type and /t(M(S)) = /l = constant. Since the system is open any number of customers is 
feasible at a service center. 

Therefore 
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-=zz-z n 



n l =0n 2 =0 n N = 0 \ i = 1 



0r C_1 = 



n, =0 V M 



If service center i is type 1 and (l i ( /?. ) — fj- 



— 1 ^ h If service center i is type 2 or 4 

v heR, Mir , 



y 

,reR, Pi r 



If service center i is type 3 



Marginal Distribution at a Service Center in an Open System 

Let P ( Tlj : ) be the equilibrium probability that there are n, 



customers at service center /. 



iv ^ 

p , ( n i ) = CWh, {n t )fl £ (rij ) 



7=1 V"l =0 

j*i 



Using the expression for C, we reduce this to 



p iM= 



oo 



ft 



if service center i is type 1 . 



a=Z^ 

% ft,. 



if service center i is type 2, 3 or 4. 



P {n. )=(i -p,)p! if service center i is type 1, 2 or 4. 



If service center i is type 3. 



Impact Factor (JCC): 4.6257 



NAAS Rating: 3.80 




Different Distributions in Queueing Networks 



57 



These results provide a convenient way of examining the equilibrium distribution at a service center. For type 1, 2 
or 4 service stations the marginal distribution is the same as the distribution of the number of customers in an M / M / 1 
queue with a suitably chosen utilization, . For the equilibrium solution to exist each is required to be less than 1 . 



The marginal distribution for a type 3 service center is the same as the equilibrium distribution for the number of 

_ * 

customers for an M/G/oo 

system with p . — — . This certainly appears to be reasonable since for open properties of 

P 

network models that satisfy local balance. 

Consider a general service time distribution represented by a network of stages as in Figure 1 . Let this represent 
the service time distribution for a customer in class r in service center i. We introduce n new customer classes denoted by 
r h r 2 ,...,r„ which correspond to the stages in this network and delete customer class r. 

1 , V 

The service time of a class Y ( customer will be exponential with mean ( ) < £ < // ) . The transition 

Pi 

probabilities for a class Y f customer are defined as: 



Pi ,rpj,s = £ P irjs 



Pi , r t ; i, r M = a, 1 <i<n 

To take care of the transitions into class r in the original model we require that all transitions into state r be 
redefined as transitions into state r h These transition probabilities are defined as: 

P , . = P . , j,S 

With this transformation of the model a customer will have the same distribution of total time at a service center 
and will have the same transition probabilities from service center to service center. 

After performing this transformation for each customer class with a general service time distribution we have a 

1 

model in which all service time distributions are exponential. Suppose that is the mean service time of a class r 

Pi, r 

customer at service center i. Let 

p { = max \_M it ] 



1 

We redefine the mean service time for each class of customers at service center i to be . Now we redefine the 



Pi 



transition probabilities out of service center i, 
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Let P r 




Mi 



Then define 



P' 

i,r,i,r 



P' 



= P r+{ 1 -P r ) P i,r,i,r 

= I 1 P r ) P i,r\j,s 



The effect of these new transition probabilities is to cause a class r customer to be fed back (or to revisit) service 
center i a random number of times. Each time the class r customer enters service center ; his service time is exponentially 

1 

distributed with mean . The number of visits the class r customer makes to service center i (between transitions in the 

Mi 



original model) is geometrically distributed with mean 



1 



l ~P, 



. It is easily shown that the total service time of the class r 



customer at service center i is exponentially distributed with mean 



1 ~P 



1 1 



<■ J 



Mi Mi. 



by Feller [8]. Therefore we 



have not changed the total service time distribution for this customer at service center i. 

Poisson Process and the Exponential Distribution 

An arrival process {N ( t ), t □ DO}, where N (f) denotes the total number of arrivals up to t, with N (0) = 0,Dand 
which satisfies the following three assumptions: 



• The probability that an arrival occurs between time t and time t □ □ □ t is equal to □ □ □ Cf □ Co C (17). We write 
this as Pr{ arrival occurs between t and t □ □ □ tU } □□□□□□/□□ Do (□ t), where □ Zis a constant independent 
of 

N (f), Ut (is an incremental element, and o (Ut) denotes a quantity that becomes negligible when compared to 
Cr as Cf — >C0; that is, 



• lim 

At-> 0 



o(At) 

At 



= 0 



• Prfmore than one arrival between t and t □ □ C t) □ Do (Ut); 

The numbers of arrivals in non-overlapping intervals are statistically independent; that is, the process has 
independent increments. 



If we want to calculate p n (t), the probability of n arrivals in a time interval of length t, n being an integer □ DO 
then We will do this by first developing differential-difference equations for the arrival process as follows 

p„(t + 0 □ t) I.! .Prju arrivals in t and zero in Ot] 



□ I :Pr {« □ □ 1 arrivals in t and one in Ut} 
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□ DPr {n □ D2 arrivals in t and two in □/} 

□ □ □ □ Pr {0 arrivals in t and n in □ /} (n 0 HI) 

Using assumptions (i), (ii) and (iii), Equation (5.5) becomes 

P„ ( t + At) = P„ (r)[l- AAt -o(At)] + P n - 1 (t)[AAt + o{At)] + o(At), 

Where the last term, o ( t), represents the terms 
Pr [n - j arrivals in t and j in Hr; 2 □ □/□ On}. 

For the case n = 0, we have 

Po it + At) = P 0 (t )[l - kAt - o{At )\ • 

Rewriting (5.6) and (5.7) and combining all o ( t) terms 

Po ( t + At) ~ Po it) = ~AAtp 0 (t) + o(At) 

and 

P n ( t + At) - Pn it) = -hAtp n (t ) + hAtp n _ J (t) + o{At) (n> 1) 



(5.5) 



(5.6) 



(5.7) 



(5.8) 



(5.9) 



We divide (5.8) and (5.9) by Ot, take the limit as 0 1 — > 0, and obtain the following differential-difference 



equations 



lim 

At->0 



lim 

At-> 0 



Po(t + At)~ P 0 (t) _ i_,.',o(A) 



p.U + a)-p.U) -*,.«+ *p~ « + ^ 

At At 



n > 1 



Which reduce to 

dPo(t) 



dt 



-Ap 0 (t) 



(5.10) 



and 



^A=-Xp,U)+Xp,Ot) 0- (5.U) 

dt 

We now have an infinite set of linear, first order, ordinary differential equations to solve. Recall that a linear, first 
order, differential equation of the form 

^- + <P(x)y(x) = 'I'( X ) ( 512 ) 

dx 

has the solution 
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y(x ) = Ce 



-f$(x)dx + -j*(x)dx [ 



) dx 



l f'(x)dx. 



(5.13) 



Where c is a constant to be determined by boundary conditions. We will, therefore, use (5.13) to sequentially 
solve the infinite set of equations given by (5.10) and (5.11), utilizing mathematical induction to arrive at the final answer. 
It is left as an exercise to show that applying (5.13) to (5.10) and (5.11) for n = 0, 1 and 2, and using the boundary 
condition p„( 0) = 0 for 

n > 0 and p 0 (0) = 1 yields 



Po(t) = e~* 
Pi(t) = ^ te ~ h 



< 



P 2 (t) 



(At ) 2 -M 

e 

2 



P 3 (t) 



(A t) -At 
e 

3 ! 



(5.14) 



From (5.14) we conjecture the general formula to be 

Pn{t) JJlL e -^ ( n > 0) (5.15) 

n\ 



We will prove this by induction. Using (5.11) for n + 1, we have 

^d + Ap, M U) = Ap„U). 

at 



Let <P(f) -A and t F( t ) = Ap n (t) 



A(AtT 



e ; hence, from (5.15), (5.12) and (5.13), we obtain 



n\ 



- f Adt - [ Adt f [ Adt At , 

p n Jt) = Ce J +e J \e ] -e~ A, dt 

J 11 1 



—At - —At 

= te +e 



^n+\j.n+\ 



(n + l)n\ 

Use of the boundary condition P n+i (0) = 0 yields C — 0 and gives 



Pn + l(t) 



(AtT X e~ h 
(n + 1 )! 



Thus assuming (5.15) holds for n, we have shown it also for n DOl. we have proven it holds for n □ □(), 1, 2 and 
3 in (5.14); thus the proof by induction is complete. Equation (5.15) is the well-known formula for the Poisson probability 
distribution with mean At . Thus, if we consider the random variable defined as the number of arrivals to a system in a 
time t, this random variable has the Poisson distribution given by (5.15) with a mean of At arrivals, or a mean arrival rate 
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of A . 

Poisson processes have a number of interesting additional properties. One of the most important is the fact that the 
numbers of occurrences in intervals of equal width are identically distributed (stationary increments). In particular, for 

t>s,N(t)-N( s ) is identically distributed as N (t + h) — N (s + h) , with frequency function 

pAl _ s)=e -«,-AAkzi)L. 

n\ 

This can easily be seen by the following argument. Since the Poisson has independent increments [assumption iii], 
there is no loss of generality if N ( s ) and N (s + h) are assumed to be zero. Then, if the Poisson derivation is carried out for 
both N (f) and N (t + h) under assumptions (i), (ii) and (iii), the foregoing formula results for each. 

Now we will show that if the arrival process follows the Poisson distribution, an associated random variable 
defined as the time between successive arrivals (interarrival time) follows the exponential distribution. Let T be the random 
variable “time between successive arrivals”; then 

Pr{r > f} = Prjzero arrivals in times f} = p 0 (t) = e~ Xt . 

Letting A (f) represent the cumulative distribution function of T, we have 

A(f) = Pr(r <t) = l~e~ A ' 

The density function, d ( f ) , then is given by 

dA(t ) 3 -A, 

a(t )= — - — = Ae ■ 

dt 

Thus T has the exponential distribution with meanl / A . We would intuitively expect the mean between arrivals 

to be 1 j A if the mean arrival rate is A . Our analysis substantiates this. It can also be shown that if the interarrival times 

are independent and have the same exponential distribution, then the arrival rate follows the Poisson distribution, and a 
proof of this assertion follows accordingly. 

To being, let the cumulative distribution function (CDF) of the arrival counting process, Pr{iV(f) < «} - be denoted 
by P (t) ■ Then it follows that 

P n ( t ) = Pr{N(t) = n} 

= P„(f)-P„_ 1 (f) 

But, 

P (r) = Pi'{(sum of n + 1 interarrival times) > ?} ■ 
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However, the sum of independent and identical exponential random variables has an Erlang distribution (which is 
a special type of gamma distribution); hence 






■*UiL e -*‘ dx 

n\ 



(5.16) 



the transformation of variables U — X — t gives 

n n + 1 / \n 

^ \li t ) -At —Au 



i »+l -At -Am 

A e e 



— At -Am i 

-e e du 



n ! 



= r 

Jo 



n\ 



Z n—i.i 

u t 



n\ 



-du ■ 



From the binomial theorem. The 



(n-iV-il 

X an d { 



may be switched to give 



n ^n+1 



—Au n—i i 

e uau 



But f e "u" 'du is the well-known gamma function denoted by r{n — i + \) which equals («-/)! so with the 

Jo 

proper change of variables to account for A in the € ^ term of the integral, we get 

, ^(AtYe-* 

p „(t) = 2 _ l — - — a 

7=0 1 ' 

Which is clearly recognizable as the CDF of the Poisson process. 

The Poisson/exponential arrivals process derived here is sometimes referred to as completely random arrivals. 
Although the reader might think that completely random would allude to some sort of haphazard arrival process or a 
uniform distribution for interarrival times, when encountered in queueing literature it specifically refers to the Poisson 
arrival rate-exponential interarrival time pattern. This can be explained in light of the following characteristic of a Poisson 

process. Given that k arrivals have occurred in an interval [0, 7], the k times T| < T-, < < at which the arrivals 

occurred are distributed as the order statistics of k uniform random variables on [0, T\. Note that it is not interarrival times, 
but rather the times at which arrivals occurred, that are uniformly distributed. This can be proven as follows. 

^ air ' va ' s m {0l}) dt {It y . .dt t =f T (t\k)dt 

= Pr-jVj < r, < /, + dt v ...,t k < T k < t k + dt k I k arrivals in [OT]} • 

Using the definition of conditional probability gives 

Pr{f, < r, < /, +dt l ,...,t k <T k <t k +dt k and/c arrivals in [0,r]} 

Pr{^ arrivals in [0,r]} 

The numerator of the last term above can be found by making direct use of the Poisson density function and its 
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properties, since we wish to find the probability that exactly one event occurs in each of the k time intervals, (t j + dt ), 
and no events occur elsewhere, that is, in T — dt { — dt 2 — ... — dt k • Therefore, since the probability of k occurrences in a 
time t is (AtY e~ A ' /k\ , we have 



f T (t I k)dt 



_ Adt t e 



-Adt, 



Adt 2 e 



- Adt > 



...Adt t e- Mt e~ MT ~ A '~ d,2 ~-~ d ‘ l 



(AT) 



k -AT 

e / 



k\ 



Which reduces to? 



f T (t\k)dt 



A k dt { dt 2 ...dt k e AT 

(AT) k e- AT /k\ 



Jd 

rjik 



dt l dt 2 ...dt k - 



Hence 



{t v t 2 ,...,t k \k arrivals in [0^]) = ^, ^.17) 

Which is identical to the joint density of the order statistics of k random variables uniform on [0, 7] . 

Making similar assumptions as done above for arrivals, one could utilize the same type of process to describe the 
service pattern. If we change the three assumptions in the beginning of this section slightly by using the word service 
instead of arrival and condition the probability statements by requiring the system to be nonempty, we would obtain a 
Poisson service rate or an exponential service-time distribution for describing the service pattern. In the following section, 
we prove an important property of the exponential distribution which aids in a relatively simple analysis of queueing 
problems when arrival and service patterns exhibit the Poisson/exponential characteristics as derived in this section. 

CONCLUSIONS 

These results unify and extend a number of separate results on networks of queues. The general model can have 
four types of service centers. Three of those types allow different service time distributions with rational Laplace 
transforms for different classes of customers. The model allows different classes of customers to have different arrival rates 
and different routing probabilities. For open networks some very simple formulas give the marginal distribution of 
customers at the service centers of the network. 
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